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PERSONAL USER AGENT 



Related Applications 

[0001] The present application is related to U.S. 
Application No. 10/006,942, entitled COMPOSITE USER AGENT, 
filed December 4, 2001 in the name of Ramsayer et al . , the 
disclosure of which is incorporated herein in its entirety. 

Field of the Invention 

[0002] The present invention relates to controlling 
packet-switched media sessions, and in particular, relates 
to a personal user agent for controlling media sessions 
amongst an associated group of devices. 

Background of the Invention 

[0003] The evolution of packet-switched communications 
now allows various types of media to be communicated over a 
common network to devices capable of receiving and 
processing compatible media. Currently, there exists an 
eclectic offering of devices capable of supporting data, 
audio, and video media, alone or in any combination. For 
example, a personal computer may support all three types of 
media, whereas a video device may support only video media, 
a packet-switched telephone may support only audio media, 
and a personal digital assistant (PDA) may support voice and 
data. In essence, there are numerous devices having a mixed 
array of media capabilities. 

[0004] In an effort to maximize the benefit of having 
these various media capabilities, users often have a number 
of devices with various media capabilities. Further, users 
may have more than one device with a common media 
capability, but may have a preference of one device over 
another for a given media capability, depending on quality, 



venue, or time of communication. Unfortunately, there is no 
efficient way for a user to manage communications using the 
various devices in light of their respective media 
capabilities. To establish a video session between a 
personal computer and another video device, the user must 
establish the video session, and if a related audio session 
should be created between the personal computer and an audio 
device, the user must control the establishment of a session 
between the personal computer and the audio device. In 
order to establish the separate audio and video sessions, 
the user must establish the respective sessions as if they 
were unrelated. 

[0005] As such, there is a need for a way to efficiently 
manage multiple devices having various media capabilities. 
There is a further need to automate the establishment of 
various sessions based on the type of media and the 
capability of the respective devices. Where multiple 
devices have a common capability, there is a need for an 
efficient and automated way to select a preferred one of the 
devices to establish a media session. 

Summary of the Invention 

[0006] The present invention relates to a personal user 
agent acting on behalf of a group of member device agents in 
a communication network. The personal user agent provides 
its group of member device agents with a specialized proxy 
function while representing the group to the network as a 
single user agent. To devices on the communication network, 
the personal user agent behaves and is viewed as a user 
agent. To the group of member device agents, the personal 
user agent behaves and is viewed as both a registrar and a 
proxy server . 

[0007] Although the personal user agent understands the 
make-up of the group of member device agents, the member 



device agents need not have knowledge of each, other or that 
they are being represented by the personal user agent to 
non-member devices. The personal user agent is configured 
to route incoming messages to one or more of the member 
device agents based on the capabilities of each of the 
particular member device agents. A user may configure the 
personal user agent to establish preferences or priorities 
for handling media or establishing sessions amongst the 
member devices. 

[0008] In one embodiment, all member device agents 
register with the personal user agent prior to 
communicating. The personal user agent will then register 
with a proxy to provide an address or addresses to reach the 
user. After registration with the proxy, all incoming 
messages from the network are directed to the personal user 
agent before being passed to the appropriate member device 
agent. The member device agents locally configure 
themselves to send all requests to the personal user agent. 
As noted, from the viewpoint of the member agent, the 
personal user agent will appear as a proxy, handling all the 
responsibilities of a traditional network proxy. 
[0009] A user may add additional capabilities to a 
session through the existing member device agent, or by 
adding an additional member device agent to the session. 
The other user involved in the session may also add media to 
the session by sending a message to the personal user agent 
requesting additional media to be added to the session. The 
personal user agent will determine if an additional member 
device agent needs to be brought into the session based upon 
which member device agent is preferred for the requested 
media type and establish the session with the additional 
member device or the existing device. 

[0010] Those skilled in the art will appreciate the scope 
of the present invention and realize additional aspects 



thereof after reading the following detailed description of 
the preferred embodiments in association with the 
accompanying drawing figures. 

Brief Description of the Drawing Figures 

[0011] The accompanying drawing figures incorporated in 
and forming a part of this specification illustrate several 
aspects of the invention, and together with the description 
serve to explain the principles of the invention. 
[0012] FIGURE 1 is a block representation of a 
communication environment configured according to one 
embodiment of the present invention. 

[0013] FIGURE 2 is a simplified communication environment 
for an exemplary embodiment of the present invention. 

[0014] FIGURE 3 is an exemplary communication flow 
diagram wherein User Y uses a single desktop application to 
make an audio and video call to User X, who uses a video 
application for video and a telephone for audio according to 
a preferred embodiment of the present invention. 

[0015] FIGURE 4 is an exemplary communication flow 
diagram wherein User X originates a call from a telephone 
and a video application is automatically brought into the 
communication session according to a preferred embodiment of 
the present invention. 

[0016] FIGURE 5 is a block representation of a composite 
system capable of implementing a personal user agent 
according to one embodiment of the present invention. 

Detailed Description of the Preferred Embodiments 
[0017] The present invention provides for an agent that 
acts on behalf of a group of associated devices on a 
communication network. The agent provides its group of 
devices with a specialized proxy function, while 
representing the group to the network as a single entity. 



The agent routes incoming messages to the various devices 
based on the device's media capability. One or more 
communication sessions may be established via the agent 
between one or more devices based on the type of media 
session. The concepts of the present invention are 
applicable to various communication environments and related 
protocols . 

[0018] The embodiments set forth below represent the 
necessary information to enable those skilled in the art to 
practice the invention and illustrate the best mode of 
practicing the invention. Upon reading the following 
description in light of the accompanying drawing figures, 
those skilled in the art will understand the concepts of the 
invention and will recognize applications of these concepts 
not particularly addressed herein. It should be understood 
that these concepts and applications fall within the scope 
of the disclosure and the accompanying claims. 
[0019] In the communication environment 10 illustrated in 
Figure 1, a packet-switched network 12 is provided in 
association with a proxy 14, which facilitates media 
sessions between any number of endpoints 16A-16D. These 
endpoints 16 may support any one or a combination of data, 
audio, and voice media sessions, depending on the 
configuration of the device. Although not inclusive, 
typical endpoints 16 may take the form of a personal 
computer (PC) 16A, a direct or wireless packet -switched 
compatible telephone 16B, a PDA 16C, or a gateway 16D 
capable of supporting any number of telephony devices or 
providing an interface to other networks, as will be 
described in more detail below. For clarity, a generic 
endpoint will be referenced as 16. 

[0020] An endpoint 16 is capable of running an 
application, which is generally referred to as a device 
agent 18, capable of facilitating media sessions using a 



corresponding protocol. The term device agent, or member 
device agent as used below, may represent any type of 
protocol agent, interface, or communication function, 
supporting media capabilities for a device either directly 
or indirectly via a gateway, proxy, or the like. Device 
agents 18 typically register their ability to establish 
sessions with the proxy 14 to inform the proxy 14 of the 
universal resource locator (URL) that identifies the device 
agent 18 to the network 12. The device agent 18 may also 
provide information about how it can be reached over the 
network 12. The information typically includes the Internet 
Protocol (IP) address and port that the user agent 18 will 
use for media sessions. 

[0021] Typically, when a device agent 18 wants to 
establish a session with another device agent 18, the device 
agent 18 initiating the session will send a request to the 
proxy 14 and specify the targeted device agent 18. 
Identification of the device agent 18 may take the form of a 
URL. The proxy 14 will use the URL provided in the message 
to determine if the targeted device agent 18 is registered 
with the proxy 14. Generally, the user name is unique 
within the name space of the specified domain. 

[0022] If the targeted device agent 18 has registered 
with the proxy 14, the proxy 14 will send a message directly 
to the targeted device agent 18 to establish a session 
between the respective device agents 18. Media capabilities 
are passed between the two user agents 18 of the respective 
endpoints 16. Once respective endpoints 16 are in an active 
session with each other and have determined each others 
capabilities, the specified media content may be exchanged 
during an appropriate media session. 

[0023] The present invention provides for a personal user 
agent 20, which is an application program that acts on 
behalf of a group of device agents 18, designated as member 



device agents 18'. The personal user agent 20 provides its 
group of member device agents 18 ' with a specialized proxy 
function while representing the group to other device agents 
18 over the network 12 as a single device agent 18. Each 
member device agent 18' is a device agent 18 that has 
registered with and is being represented by the personal 
user agent 2 0 . 

[0024] Preferably, to device agents 18 over the network 
12, the personal user agent 20 behaves and is viewed as a 
single device agent 18 having the media capabilities of all 
of the member device agents 18'. Other device agents 18 
interacting with the personal user agent 20 need not have 
knowledge of the individual member device agents 18 ' 
represented by the personal user agent 20. The personal 
user agent 2 0 and the associated endpoints 16 implementing 
the member device agents 18 r form a user domain 22, 
[0025] To the member device agents 18 ', the personal user 
agent 2 0 behaves and is viewed as both a registrar and a 
proxy server. The personal user agent 20 is aware of the 
member device agents 18' within the user domain 22; however, 
the member device agents 18' need not be aware of each 
other, even when two or more of the member device agents 18' 
are involved in associated multimedia sessions. Preferably, 
the personal user agent 20 is configured to route incoming 
messages configured to establish a media session or sessions 
to one or more of the member device agents 18 r based on the 
capabilities of the respective member device agents 18'. 
Preferably, the personal user agent 20 is viewed by devices 
with which it interfaces as either a device agent 18 or a 
network proxy 14, as defined in their supporting protocols. 
[0026] In one embodiment, the personal user agent 20 
includes three components: a session manager, a call 
manager, and a data manager. A session is generally defined 
as an exchange of messages between the personal user agent 



20 and another entity. The session manager will handle the 
reception of incoming messages and transmission of outgoing 
messages for each protocol supported by the personal user 
agent 20. The session manager will notify the call manager 
when messages have been received or transmitted, and 
maintain a list of active sessions, which are each 
preferably identified by session identification (ID) , The 
session manager may also be responsible for storing and 
providing access to all messages received or transmitted for 
each session. 

[0027] A call is generally defined as a set of all 
sessions and media streams used between two end users. A 
call manager may be responsible for maintaining a list of 
active calls and the sessions and media streams associated 
with each call, as well as deciding what course of action to 
take when an event occurs. The events may include, for 
example, an incoming message being reported by the session 
manager. The call manager may also provide an interface 
with addressing applications, such as Microsoft Outlook's 
contact list, when a destination address is needed. 
[0028] The data manager may provide an interface to the 
user to allow for the provisioning of device addresses, the 
user's public address, call configurations, and any other 
provision data. The data manager may handle dynamic and 
static presence information for each device in the user 
domain 22 and store the call configurations, such as 
profiles, to be used when originating calls based on the 
device used to originate the call. The data manager may 
also store call configurations to be used when terminating 
calls based on the termination address used. The call 
configurations may define associated devices necessary to 
facilitate related media sessions. 

[0029] Continuing with Figure 1, various types of media 
sessions may be established through numerous devices. As 



noted, these sessions may be facilitated through direct or 
wireless packet-switched networks using IP, Wireless 
Application Protocol (WAP), and the like. Communications 
extending to other networks may be facilitated through a 
gateway 16D, which also runs an application implementing a 
member device agent 18'. The gateway 16D may be configured 
to facilitate communications between the network 12 and a 
disparate network, such as the public switched telephone 
network (PSTN) 24. As such, audio and data communications 
may be facilitated through devices supported by the PSTN 24, 
such as telephony device 26. Alternatively, the gateway 16D 
may directly support one or more telephony devices 28. 
[0030] Typically, these telephony devices 26, 28 
incorporate circuit-switched communications, wherein the 
gateway 16D must be configured to translate between packet- 
and circuit-switched communications. Notably, the PSTN 24 
may support, include, or otherwise be associated with 
wireless communication networks facilitating circuit- 
switched communications. These wireless circuit-switched 
networks facilitate communications with mobile terminals 30, 
such as wireless telephones and PDAs, through base stations 
32 in traditional fashion. 

[0031] In one embodiment, the personal user agent 2 0 is 
provisioned with the following information. First, the 
address of each endpoint 16 and the media or medias it 
supports. This may be accomplished by having each endpoint 
16 dynamically register with the personal user agent 20, as 
well as providing static provisioning. Second, the personal 
user agent 20 should be provided the public addresses that 
others will use to contact the user associated with the user 
domain 22. The personal user agent 20 will register these 
addresses with the network proxy 14. The present invention 
allows the user to have one or more addresses; however, the 
user may choose to use only a single address, even though 



multiple endpoints 16 and medias may be used. Third, the 
personal user agent 20 should have a list of medias and 
endpoints 16 that a user wishes to use when originating a 
call from any one of the various endpoints 16. Fourth, the 
personal user agent 2 0 should have a list of medias that are 
permitted when terminating a call based upon the termination 
address being used. Fifth, the personal user agent 20 
should have a list of devices to be used for each media when 
terminating a call based upon the termination address used. 
Preferences may also be indicated for each device in the 
list based upon where the user may be when a call is 
received. The call manager function may use this 
information, plus the availability of each device, if known, 
at the time of the call to determine which device to use. 
[0032] As noted, all member device agents 18' within the 
user domain 22 that wish to be represented by the personal 
user agent 20 must register with the personal user agent 20. 
As such, each member device agent 18 ' may send a 
registration message to the personal user agent 20, or the 
personal user agent 20 may be configured with registration 
data corresponding to each member device agent 18'. 
Independent of the registration of the member device agents 
18', the personal user agent 20 should register with the 
proxy server 14 to provide the various addresses 
corresponding to the member device agents 18' within the 
user domain 22. Once registration is complete, all incoming 
session requests from the network 12 are directed to the 
personal user agent 20 before being passed to the 
appropriate member device agents 18'. Also note that a 
member device agent 18' that has registered with the 
personal user agent 20 may also register with the proxy 14 
using another address. This allows the personal user agent 
20 to be bypassed when desired. 



[0033] All member device agents 18 1 are configured to 
send session requests to the personal user agent 20. From 
the viewpoint of the member device agents 18', the personal 
user agent 20 acts as a proxy handling all the traditional 
responsibilities of a traditional network proxy 14. In most 
cases, the personal user agent 20 will pass all incoming 
requests from its member device agents 18 T to the network 
proxy 14; however, it may be desirable for the personal user 
agent 20 to send session requests directly to a remote user 
agent 18 using a corresponding URL, if such capability is 
desired. 

[0034] The personal user agent 20 is differentiated from 
traditional proxies in that it can be configured to route 
session requests to one or more of its member device agents 
18 r based upon capabilities of the respective member device 
agents 18'. Traditionally, a proxy has the ability to fork 
session requests when more than one user agent 18 is 
registered using the same address, but the choice is to 
either send the request to all, such as a multicast session, 
or to just one, such as a unicast session, wherein the 
decision is made independently of the capabilities of each 
user agent 18. The personal user agent 20 is different, in 
that it examines content information of incoming messages 
and routes the message to the preferred member device agent 
18' that handles the media type specified in the message. 
If more than one media type is requested, the personal user 
agent 2 0 may route the message to each member device agent 
18' that is preferred for each media type. 
[0035] When the user domain 22 includes member device 
agents 18' supporting common media types, various types of 
profiles and preferences may be defined in the personal user 
agent 20. The profiles and preferences may dictate 
selection of a member device agent 18' based on priority, 
timing, availability, and the like. For example, a first of 



two member device agents 18 ' supporting a common media type 
may be selected during normal work hours, while the other 
may be selected during non-work hours. The profiles or 
preferences may also make these selections based on the need 
for additional media capabilities or the source of incoming 
media. Those skilled in the art will recognize numerous 
variations and combinations for such profiles and 
preferences . 

[0036] The manner in which the personal user agent 20 
determines which member device agent 18' is preferred for 
each media type is a matter of implementation. The 
preferences or profiles can be provisioned on each personal 
user agent 20, or the personal user agent 20 could query the 
capabilities of each member device agent 18'. If the 
personal user agent 20 receives a message with a media type 
that is not supported by any of its member device agents 
18', the personal user agent 20 could respond with a message 
indicating that the media type is not supported. 
[0037] A couple of exemplary scenarios follow in view of 
the communication environment 10 illustrated in Figure 2. 
For the purposes of illustration, pseudo messages are used 
in a generic fashion to highlight the concepts of the 
invention. Those skilled in the art will recognize the 
various protocols and messaging schemas that can take 
advantage the concepts described herein. As illustrated, a 
composite system 38, which represents any type of computing 
device, is used to implement the personal user agent 20A. 
The composite system 3 8 forms the user domain 22 with two 
endpoints 16: an audio device 34 implementing a member 
device agent 18A', and a video device 36 implementing a 
member device agent 18V . As described above, the device 
agents 18A' and 18V for the respective audio device 34 and 
video device 3 6 have registered with the personal user agent 



20A of composite system 38. The user associated with the 
user domain 22 and the personal user agent 20A is User X. 
[0038] Given the configuration of Figure 2, the user 
domain 2 2 for User X has audio capability through audio 
device 34 and video capability through video device 36. In 
the illustrated embodiment, the video device 3 6 is a video 
camera running on composite system 38, which is a personal 
computer. The personal user agent 20A recognizes the 
respective devices and their capabilities, and has 
registered with the proxy 14 as a single device agent on 
behalf of both the audio device 34 and video device 36. 
[0039] Assume that User X of the user domain 22 desires 
to participate in a media session requiring audio and video 
capabilities with User Y, who has an audio/video device 40, 
such as a multimedia personal computer having an audio 
device 42 and video device 44. From the perspective of the 
proxy 14 and the user agent 18A/V running on the audio/video 
(A/V) device 40, the media session with User X must be 
established with the personal user agent 20A of the 
composite system 3 8 as if it were a traditional endpoint 16 
and device agent 18. 

[0040] An exemplary communication flow diagram is 

illustrated in Figure 3 wherein User Y uses a single desktop 
application to make an audio and video call to User X, who 
uses a video application for video and a telephone 34 for 
audio. Initially, the device agent 18A/V resident on A/V 
device 40 of User Y originates a multimedia session from an 
audio and video application to User X using User X's public 
IP address by sending a SETUP message containing an audio 
and video session description (step 100) . The network proxy 
14 will route the message to the personal user agent 20A 
residing on the composite system 38 of User X. 



[0041] Upon receipt of the message, the personal user 
agent 20A will check a profile identifying terminations that 
use User X's public IP address. Assuming both audio and 
video terminations are possible, the personal user agent 20A 
determines which of the endpoints should be used to 
establish sessions based on the available endpoints, their 
capabilities, the state of the endpoints, the location of 
User X, or a combination thereof. Those skilled in the art 
will recognize other selection criteria. For this example, 
assume that User X is in his office and has chosen to use 
the audio device 34, such as a telephone, for audio sessions 
and the video device 36, such as an application on a 
computer and associated camera, for video sessions. The 
audio and video devices 34 and 3 6 include the audio and 
video device agents 18A' and 18V, respectively. 
[0042] Once the audio and video devices 34 and 36 are 
selected, the personal user agent 20A creates an audio 
session with the audio device 34 via the audio device agent 
18A'. The audio session is initiated by sending a SETUP 
message including a description of the audio session to the 
audio device agent 18A' (step 102) . In response, the audio 
device agent 18A' will send an ALERTING message to the 
personal user agent 20 indicating that the audio device 
agent 18A' is attempting to the establish the session (step 
104) . During this time, the audio device 3 4 may ring to 
alert User X of the incoming session or call. The personal 
user agent 2 OA will forward the ALERTING message to the 
device agent 18A/V for User Y on behalf of the audio device 
agent 18A' (step 106) . Once the audio device agent 18A' 
establishes the termination for the audio session, it will 
send an ANSWER message including a description for the audio 
session to the personal user agent 20A (step 108). 
[0043] Next, the video session is initiated by sending a 
SETUP message including a description of the video session 



to the video device agent 18V (step 110) . Once the video 
device agent 18V establishes the termination for the video 
session, it will send an ANSWER message including a 
description for the audio session to the personal user agent 
2 OA (step 112) . Upon determining that the terminations for 
the audio and video sessions are established, the personal 
user agent 2 0 will forward and ANSWER message including the 
audio and video descriptions to the device agent 18A/V of 
User Y (step 114) . 

[0044] In response to the ANSWER message from the 

personal user agent 2 OA, the device agent 18A/V of User Y 
will initiate an ACKNOWLEDGE message for the audio and video 
sessions to the personal user agent 2 OA (step 116) . The 
personal user agent 20A will then send an ACKNOWLEDGE 
message for the video session to the video user agent 18V 

(step 118) and send an ACKNOWLEDGE message for the audio 
session to the audio user agent 18A' (step 120) . At this 
point, an audio session is established between the audio 
device agent 18A' of User X and the device agent 18A/V of 
User Y, and a video session is established between the video 
device agent 18V of User X and the device agent 18A/V of 
User Y. 

[0045] With reference to Figure 4, an exemplary 
communication flow diagram is illustrated wherein User X 
originates a call from a telephone 34 and subsequently a 
video application is automatically brought into the 
communication session. Initially, User X initiates a call 
from the audio device 34 to User Y's A/V device 40. 
Accordingly, the audio device agent 18A' resident on audio 
device 34 originates a multimedia session to User Y using 
User Y's public IP address by sending a SETUP message 
containing an audio session description to the personal user 
agent 2 OA (step 200) . The personal user agent 2 OA may then 



check profiles associated with originations made from the 
audio device 34. 

[0046] Assume that video is to be included in the session 
along with the audio. Next, the personal user agent 20A 
determines which of User X's endpoints should be used to 
handle the video session. For the present example, assume 
that video device 3 6 and the composite device 3 8 combine to 
provide a bi-directional video session. Again, the personal 
user agent 20A determines which of the endpoints should be 
used to establish the video session based on the available 
endpoints, their capabilities, the state of the endpoints, 
the location of User X, or a combination thereof. 
[0047] Once the device to handle the video session is 
determined, the personal user agent 20A will set a flag to 
automatically establish the video session in association 
with the call once User Y answers. Alternatively, the 
personal user agent 2 OA could decide to establish the video 
session prior to establishing the call. Assuming the call 
should be answered prior to continuing, the personal user 
agent 20A will then send a SETUP message with an audio 
session description to the device agent 18A/V (step 202) , 
which will respond by initiating ringing, or like alert for 
User Y, and sending an ALERTING message back to the personal 
user agent 20A (step 204) . The personal user agent 20A will 
forward the ALERTING message to the audio device agent 18A' 
(step 206). When User Y answers the call, the device agent 
18A/V will send an ANSWER message including the audio 
session description to the personal user agent 20A (step 
208), which will forward the ANSWER message to the audio 
device agent 18A' (step 210) . The audio device agent 18A' 
will respond by sending an ACKNOWLEDGE message to the 
personal user agent 20A (step 212), which will forward the 
ACKNOWLEDGE message to the device agent 18A/V (step 214) . 



[0048] At this point, the audio session between User X 
and User Y is established and the personal user agent 20A 
will initiate the video session. To initiate the video 
session, the personal user agent 20A may send a SETUP 
message with a null video description to the video device 
agent 18V 7 (step 216) , which will trigger the video device 
agent 18V to send an ANSWER message containing the 
appropriate video session description to the personal user 
agent 20A {step 218) . In response, the personal user agent 
20A will send a SETUP message, including the audio and video 
session descriptions for the established audio session and 
the requested video session, to the device agent 18A/V of 
User Y (step 220) . The device agent 18A/V will send an 
ANSWER message including its audio and video session 
descriptions to the personal user agent 20A (step 222) , 
which will send ACKNOWLEDGE messages to the device agent 
18A/V of User Y (step 224) and the video device agent 18V 
of User X (step 226) , At this point both the audio and 
video session are established between the respective devices 
of User X and User Y. 

[0049] As illustrated in Figure 5, a typical composite 
system 3 8 may include a control system implemented with a 
central processing unit (CPU) 46 associated with memory 48. 
The memory 48 would contain the necessary software 50 and 
data 52 for implementing the personal user agent 20. A 
network interface 54 is also associated with the CPU 46 to 
facilitate packet-switched communications over the network 
12. 

[0050] The present invention provides for integrating and 
aggregating end user communication devices on a per user 
basis in order to provide numerous benefits and 
capabilities. A user may be contacted using a single 
address, regardless off which means of communication is 
being used and regardless of the user's location. For 



example, userX@nortelnetworks.com is an address used to 
place a voice call to User X whether he is in the office, 
can be reached on his mobile terminal, or is at home. The 
technique can also be used when sending an instant message 
to User X at any location. Further, users may engage in a 
multimedia communication session using disparate collections 
of single and multiple media communication devices. As 
outlined above, User Y uses a single desktop application to 
make a voice and video call to User X, who uses a video 
application for video and an office telephone for audio. 
The user may also configure unique sets of media and the 
respective devices to be used when starting a communication 
session, based on which communication device is used to 
originate the session. For example, if User X originates a 
call from his office phone, his video application on his 
personal computer is automatically brought into the 
communication session. If he originates a call from his 
mobile phone, no additional devices are brought into the 
session. 

[0051] A user may configure unique sets of media to be 
permitted when accepting a communication session based on 
the address used to establish the session. For example, 
video and audio is permitted when User X's business address 
is used, but only audio is permitted when his home address 
is used. For each media type permitted when accepting a 
communication session based on the address, a user may 
configure a list of devices to be considered for use. From 
this list, dynamic presence information can be used to 
determine which device to use. For example, assume that 
User X has configured a list of all his audio devices to be 
used when audio calls are made to his business address. The 
call will be sent to his desk telephone unless he is away 
from his desk and his mobile phone is active, in which case 
the calls will be sent to his mobile telephone. Various 



techniques for presence detection may be used, such as 
monitoring keyboard activity or the activation of a screen 
saver. 

[0052] A user may add additional media to communication 
sessions without having to make an additional call or 
specify an address. For example, application sharing can be 
added to an audio call using the existing signaling session 
already established. Thus, a separate call is not needed. 
Furthermore, the address that is used when placing the audio 
call is reused again when adding the application sharing 
session. 

[0053] The user may initiate a call from a device or 
application for the sole purpose of providing an address for 
the call, while other devices are actually used in the 
communication session. For example, selecting User Y from 
Microsoft Outlook's contact list may cause User X's office 
telephone to ring, and upon answer, establish a multimedia 
call with User Y. This capability supplies an address book 
capability to devices „ that do not have one. It can also be 
used with devices that have their own address capability, 
but wherein the user wishes only to use and maintain a 
single address book across all devices. 

[0054] The user may also configure a controlling media 
type that when placed on hold, released, etc., will cause 
all other media in the communications to be treated in the 
same manner. Assume that User X and User Y are involved in 
an audio and video communication session, and User X has 
configured audio to be his controlling media type. Upon 
User X hanging up his phone, his associated video device is 
also released, and the session with User Y will end. If 
User X has closed his video application first, he would 
still keep the audio connection with User Y, if so desired. 



[0055] Those skilled in the art will recognize 
improvements and modifications to the preferred embodiments 
of the present invention. All such improvements and 
modifications are considered within the scope of the 
concepts disclosed herein and the claims that follow. 



